PICTURE ENCODING SYSTEM CONVERSION DEVICE 
AND ENCODING RATE CONVERSION DEVICE 



FIELD OF THE INVENTION 
5 [OOOI] 

This invention relates to a picture (or image) encoding 
system conversion device and encoding rate conversion device and, 
more particularly, to a device which performs rate control 

^ taking both the picture quality and time delay accompanying the 

10 conversion into account. 

; [0002] 

BACKGROUND OF THE INVENTION 

In a digital picture (or image) communication system or a 

=5 digital picture communication service, the technique of 

T5 encoding the picture information to reduce the information 
volume to effect transmission and storage is used in 
transmitting and storing the picture information. As an 
encoding system for moving picture, internationally 
standardized by ITU-T (International Telecommunication Union), 

20 there are known an encoding system prescribed by H. 261 

Recommendations providing for standardization of transmitted 
pictures of visual telephone and video conference and H. 263 
Recommendations providing for standardization of pictures 
transmitted over a low bitrate network, such as PHS (Personal 

25 Handy-Phone System) . 
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[0003] 

In the encoding system for moving pictures, 
internationally standardized by ISO (International 
Organization for Standardization), there is known MPEG (Motion 
Picture Experts Group) 1, as an encoding system for stored video 
images, while there are known MPEG-2 and MPEG4 as a universal 
encoding system and a low bit rate encoding system, 
respect i ve I y. 
[0004] 

The respective encoding systems used for moving picture 
compression are merely analogous to one another to the extent 
that these systems use the DCT (Discrete Cosine Transform), 
motion compensation prediction and Huffman codes in common, 
whi ch const i tutes on I y a part. However, b i tst reams obta i ned on 
actual encoding differ from one system to another. 
[0005] 

So, if it is desired to interconnect a system employing a 
certain picture encoding system to another encoding system 
employing another encoding system, picture codes, once formed, 
need to be decoded into picture signals, which then need to be 
re- encoded as an input picture. 
[0006] 

For example, if the H. 261 bitstream is to be converted into 
that of H. 263 or MPEG4, not having the in-loop fi Itering function, 
such as one provided in H.261, it is necessary to decode the 
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encoded bitstream into an input picture and to re-encode the 

resu I ting picture si gna I s. 

[0007] 

On the other hand, if it is desired to convert a bitstream 
of H. 263 or MPEG4 into that of H. 261, it is necessary to decode 
the bitstream into a picture and to re-encode the resulting 
picture. This is because the maximum value of the motion vector 
of H. 263 or MPEG4 is larger than that of the motion vector of 
H.261, while the motion vector of H. 261 merely has the vector 
merely of an integer precision. 
[0008] 

That is, for converting a picture encoding system into 
another appreciably different picture encoding system, it is 
necessary for transforming a bitstream to interconnect a decoder 
to an encoder, first to revert the input bitstream transiently 
into picture signals by a decoder, and then to re-encode the 
picture signals as an encoder input signal. 
[0009] 

For moving picture data, encoded in accordance with a 
certain encoding system, there is known an encoding rate 
converting system, as a method for realizing rate conversion 
between an input bitstream and an output bitstream. This rate 
conversion is carried out when the bandwidth of a transmission 
channel for the input bitstream differs from that of 
transmission channel for an output bitstream. 
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• . [0010] 

Fig. 10 shows an embodiment of a structure of a conventional 
p i cture encod i ng system convert i ng dev i ce. Ref er r i ng to F i g. 1 0, 
this picture encoding system converting device includes a buffer 
5 5 for storing a bi tstream output from outside, a decoder 6 for 
decoding picture codes output from the buffer 5, an encoder 7 
for encoding picture signals output from the decoder 6 and 
another buffer 8 for storing picture codes output from the 
encoder 7 to output the picture codes to outside. 
10 [0011] 

The encoder 7 monitors the storage volume (occupied volume) 
in the buffer 8. This stored volume in the buffer is utilized 
for controlling the volume of the generated codes during 
encoding by the encoder 7. 
15 [0012] 

As this sort of the picture encoding system conversion 
device, there is proposed in e.g., JP Patent Kokai J P-A-7-1 07461 
a picture encoding system conversion device adapted for storing 
the hysteresis information of encoding parameters, such as 
20 motion vector or quantization step size etc., used in decoding, 
and referencing these encoding parameters to determine the 
encoding parameters to effect re-encoding. 
[0013] 

In e.g., JP Patent Kokai J P-A-7-288804, there is proposed, 
25 as a re-encoding device for picture signals in which it is 



possible to prevent picture quality deterioration resulting 
from re-encoding and to freely select the picture quality on 
re-encoding, a configuration inwhich the number of quantization 
bits is set in addition to the prediction mode, motion vector 
and the quantization step size, as encoding parameters obtained 
on decoding an input b i t s t ream, to enable re-encoding with an 
optional data amount. 
[0014] 

In e.g., JP Patent Kokai J P-A-8-1 1 1 870, there are also 
proposed, as a method and apparatus for re-encoding the picture 
information in such a manner as to assure optimum picture qual ity 
even for a picture having encoding hysteresis, a method and 
apparatus in which re-encoding is achieved using the prediction 
mode, motion vector, quantization step size or periods or phase 
of picture types, as encoding parameters obtained on decoding 
the input bitstream. 
[0015] 

In e.g., JP Patent Kokai J P-A-1 0-32830, there is proposed 
a device for re-encoding picture signals in which the 
quantization step size acquired on decoding an input bitstream 
is used to determine the quantization step size of an encoder 
to realize the re-encoding. 
[0016] 

In e.g., JP Patent Koka i JP-A-1 0-336672, the r e i s p roposed, 
in an encoding system conversion device in which, in re-encoding 
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- encoded picture data in accordance with a different encoding 
system, the processing volume is diminished without 
deteriorating the motion vector detection accuracy, a 
configuration in which the motion vector obtained in decoding 
5 encoded picture data is stored and scaled depending on the 
conversion scale of the picture size, or is converted in quantity 
depending on the number of frames, the so scaled or converted 
motion vectors are provided as candidates and one of these 
candidates is used to effect re-encoding. 
10 [0017] 

In e. g. , JP Patent Kokai JP-A-1 1 -285002, there is proposed 
a moving picture encoding device in which quantization control 
is performed on a bitstream obtained on encoding a movingpicture 
so that the bitrate of a bitstream acquired on re-encoding will 
15 fall within a preset range. 
[0018] 

As another example of the encoding rate conversion device, 
there is proposed in e.g., JP Patent Kokai J P-A-8-25 1 587 a 
configuration of a rate conversion device for encoded picture 

20 data having a performance comparable to the transcoding using 
means simpler than the transcoding. In the above-described 
encoding rate converting device, disclosed in the JP Patent 
Kokai J P-A-8-25 1 587 t there is proposed a configuration in which 
inverse-quantized encoded data is re-quantized to control the 

25 rate control of the quantization level. However, this 
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conventional encoded picture data rate conversion device, 
described in the JP Patent Kokai J P-A-8-25 1 587, which decodes 
the received bitstream and uses the resulting encoding 
parameters to improve the picture quality on re-encoding, fails 
5 to take into account the delay time produced on effecting 
conversion of the encoding system. 
[0019] 

SUMMARY OF THE DISCLOSURE 
:; Meanwhile, i f the convers i on of the p i cture encod i ng system 

TO is to be performed off-line, time delay caused in the encoding 

system conversion is not so problematic. 

[0020] 

However, in the picture encoding system conversion used in 
f real-time communication, time delay caused in the encoding 
T5 system conversion brings about a lowered service quality. 
[0021] 

On the other hand, the conventional encoding rate 
conversion device, while stating the method for determining the 
quantization step, fails to take the time delay into account. 
20 [0022] 

The above-described conventional devices suffer the 
following problems: 
[0023] 

As a first problem, in the conventional picture encoding 
25 system conversion device stated in the above-described JP 
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Patents Kokai J P-A-7-1 07461 , 7-288804. 8-111870, 1 0-336672 and 
10-32830, in which an input bitstream is decoded and the 
resulting encoding parameters are used for encoding to convert 
the encoding system, fails to take the time delay caused in 
5 convert i ng the encod i ng system i nto account, thus occas i ona I I y 
causing marked transmission delay or lowering the encoding 
ef f i c i ency. 
[0024] 

That is, buffer delay caused in an output buffer owned by 
10 the picture encoding system conversion device is not considered 
so that the problemof overflowor underflow in the output buffer 
or the rate of the output bitstream is not taken into 
consideration, thus occasionally leading to a drastic 
transmission delay or a significantly lowered encoding 
15 efficiency. 
[0025] 

As a second problem, the picture encoding system conversion 
device, described in the above-described JP Patent Kokai JP- 
A-11-285002, showing means for limiting the range of the 
20 bi trates of the output bi tstream to wi thin a preset range, fails 
to take the realtime conversion of the encoding system into 
cons i de r at i on. 
[0026] 

That is, although the bitrate of the output bitstream is 
25 taken into consideration, no consideration is given to the delay 
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etc. produced in the output buffer. 
[0027] 

As a third problem, although the conventional picture 
encoding system conversion device re-utilizes the encoding 
5 parameters produced on decoding the input bitstream, use of the 
information on the encoding quantity that can be grasped from 
the input bitstream is not taken into account. In short, when 
the input bitstream is decoded, the encoding volume of each frame, 
each GOB (group-of-p i ctures) and each macrob I ock can be grasped, 
10 however, such encoding volume cannot be utilized effectively. 
[0028] 

With a simple encoder, it is possible to calculate an 
optimum volume of bit allocation to each frame from the band of 
the transmission channel for transmitting the bitstream and from 
15 the picture sampling interval. 
[0029] 

However, in the case of the picture encoding system 
conversion device, the picture fed to the encoder is a picture 
acquired on decoding the input bitstream, and is a picture having 
20 a diminished information volume. So, the picture quality 

cannot be expected to be improved appreciably even if the code 
volume to be allocated is increased, thus leading to an increased 
delay time. 
[0030] 

25 Conversely, i f the code vo I ume to be a I I ocated i s decreased, 
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there may be an occurrence that the band of the transmission 

channel cannot be utilized effectively. 

[0031] 

So, it is necessary to make re-encoding using the 
5 information on the code volume as grasped from the input 

bitstream to take the picture quality, delay time and the band 
of the transmission channel into consideration to effect rate 
con t ro I . 
[0032] 

"10 It is therefore an object according to an aspect of the 

present invention to provide a picture encoding system 
conversion device and an encoding rate conversion device in 
which delay time increase or picture quality deterioration may 
be decreased. 

15 It is another object according to another aspect of the 

present invention to provide a novel picture encoding system 
conversion device and an encoding rate conversion device, which 
can make best use of the information on the code volume such as 
that of encoding parameters, input buffer, output buffer, input 

20 bitstream or the output bitstream, and in which picture encoding 
system conversion and code rate conversion can be realized 
taking realtime conversion into consideration. 

Further aspects and objects of the present invention will 
become apparent in the entire disclosure. 

25 [00333 
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According to a first aspect of the present invention, there 
is provided a picture encoding system conversion device 
including a decoder receiving picture codes, compressed in 
information volume, from a reception side transmission channel 
via an input buffer and expanding the received picture codes to 
output expanded picture codes, an encoder compressing the 
picture codes, decoded by the decoder, in information volume, 
to generate picture codes to output generated picture codes from 
an output buffer to a sending side transmission channel, and a 
transcoder controller controlling the encoder. The transcoder 
controller includes an input buffer monitormonitoring the input 
buffer of the decoder, an output buffer monitor monitoring the 
output buffer of the encoder and quantization step controller 
modifying (or changing) a quantization step in the compression 
processing of the encoder based on the information from the input 
buffer monitor and the output buffer monitor. 
[0034] 

In the picture encoding system conversion device according 
to the first aspect, the decoder includes a variable length 
decoder unit, and the transcoder controller further includes a 
decoder monitor monitoring the variable length decoder unit. 

The quantization step controller modifies the quantization 
step of the encoder based on the information from the input 
buffer monitor, the output buffer monitor and the decoder 
mon i tor. 
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. [0035] 

In the picture encoding system conversion device according 
to the first aspect, the transcoder controller includes a 
reception side transmission channel monitor monitoring the 
5 state of the receiving side transmission channel, and a sending 
side transmission channel monitor monitoring the state of the 
sending side transmission channel. The quantization step 
controller modifies the quantization step of the encoder based 
on the information from the input buffer monitor, output buffer 
10 monitor, reception side transmission channel monitor and the 
sending side transmission channel monitor. 
[0036] 

In the picture encoding system conversion device, 
according to the present invention, the decoder includes a 

15 variable length decoding unit. The transcoder controller 
further includes a decoder monitor monitoring the variable 
length decoding unit, a reception side transmission channel 
monitor monitoring the state of the reception side transmission 
channel, and a sending side transmission channel monitor 

20 monitoring the state of the sending out side transmission 
channel. The quantization step controller modifies the 
quantization step of the encoder based on the information from 
the i nput buf f er mon i tor, ou t pu t bu f f e r mon i to r, decoder mon i to r, 
reception side transmission channel monitor and the sending side 

25 transmission channel monitor. 
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. [0037] 

In another aspect, the present invention provides a code 
rate conversion device including a code rate conversion unit 
receiving picture codes compressed in information volume from 
5 a reception side transmission channel by an input buffer, 
converting the code rate of the picture codes and subsequently 
sendingout the resultant picture codes through an output buffer 
to a sending side transmission channel, and a transcoder 
controller controlling the code rate, wherein the transcoder 

1_0 control ler includes an input buffer monitor monitoring the input 
buffer, an output buffer monitor monitoring the output buffer 
and a quantization step controller modifying the quantization 
step in the compression processing of the code rate conversion 
unit based on the information from the input buffer monitor and 

1=5 from the output buffer monitor. 
[0038] 

In the code rate conversion device according to the present 
invention, the code rate conversion unit includes a variable 
length decoding unit. The transcoder controller includes a 
20 decoder monitor monitoring the variable length decoding unit. 

The quantization step controller modifies the quantization 
step of the code rate conversion unit based on the information 
from the input buffer monitor, output buffer monitor and the 
decoder mon i to r. 
25 [0039] 
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In the code rate conversion device according to the present 
invention, the code rate conversion unit further includes a 
reception side transmission channel monitor monitoring the 
state of the reception side transmission channel and a sending 
side transmission channel monitor monitoring the state of the 
sending out side transmission channel. The quantization step 
controller modifies the quantization step of the code rate 
conversion unit based on the information from the input buffer 
monitor, output buffer monitor, reception side transmission 
channel monitor and the sending side transmission channel 
mon i tor. 
[0040] 

In the code rate conversion device according to the present 
invention, the code rate conversion unit includes a variable 
length decoding unit, and the transcoder controller includes a 
decoder monitor monitoring the variable length decoding unit, 
a reception transmission channel monitor monitoring the state 
of the reception side transmission channel and sending out 
transmission channel monitor monitoring the state of the sending 
out transmission channel. The quantization step controller 
modifies the quantization step of the code rate conversion unit 
based on the information from the input buffer monitor, output 
buffer monitor, decoder monitor, reception side transmission 
channel monitor and the sending out side transmission channel 
mon i tor. 
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Further aspects and modes of the present invention will 
become apparent from the entire disclosure including the 
following description and the claims. The features of the 
appended claims are herein incorporated by reference thereto. 
5 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 shows the structure of a first embodiment of the 
present invention. 

Fig. 2 shows the structure of a second embodiment of the 
« present invention. 

t:0 Fig. 3 shows the structure of a third embodiment of the 

- present invention. 

Fig. 4 shows the structure of a fourth embodiment of the 
present invention. 

Fig. 5 shows the structure of a fifth embodiment of the 
T 5 present invention. 

Fig. 6 shows the structure of a sixth embodiment of the 
present invention. 

Fig. 7 shows the structure of a seventh embodiment of the 
present i nven t i on. 
20 Fig. 8 shows the structure of an eighth embodiment of the 

present i nvent i on. 

F i g. 9 is a flow diagram showing an embodiment for 
determining the quantization step. 

F i g. 1 0 shows the structure of a conventional picture 
25 encoding system conversion device. 
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- [0041] 

PREFERRED EMBODIMENTS OF THE INVENTION 

In the following, preferred embodiments of the present 
invention are explained. Referring to Fig. 1, a picture encoding 
5 system conversion device according to a first embodiment of the 
present invention includes a decoder 1 for receiving picture 
codes, compressed in information volume, from a reception side 
transmission channel via an input buffer 21 and for expanding 
the received picture codes to output expanded picture codes. An 

10 encoder 2 compresses the picture signals, decoded by said 
decoder, in information volume, to generate picture codes to 
output the generated picture codes from an output buffer 40 to 
a sending out side transmission channel. A transcoder control ler 
3 includes input buffer monitor 52 for monitoring said input 

H buffer 21 of the decoder 1 and output buffer monitor 62 for 
monitoring the output buffer of the encoder 2. There is also 
provided a quantization step controller 71 for modifying the 
quantization step in the compression processing of the encoder 
2 based on the information from said input buffer monitor 52 and 

20 the output buffer monitor 62. 
[0042] 

Referring to Fig. 2, a code rate conversion device of a 
second embodiment of the present invention includes a decoder 
1 for receiving picture codes compressed in information volume 
25 from a reception side transmission channel by an input buffer 
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21 and for subsequently sending out the decoded picture codes 
through an output buffer 40 to a sending out side transmission 
channel. A transcoder controller 3 includes a decoder monitor 

51 for monitoring the VLD unit 22 of the decoder 1, an input 
buffer monitor 52 for monitoring the input buffer 21 of the 
decoder 1, and an output buffer monitor 62 for monitoring the 
output buffer 40 of the encoder 3. There is also provided a 
quantization step controller 72 for modifying the quantization 
step in the compression processing of the code rate conversion 
unit based on the information from the input buffer monitor and 
from the output buffer monitor. 

[0043] 

Referring to Fig. 3, an encoding system conversion device 
for converting a signal encoded in one encoding system into a 
signal of another encoding system, according to a third 
embodiment of the present invention, includes a decoder 1 for 
receiving a compression-coded signal in an input buffer 21 to 
decode the signal in a variable length decoder 22 to output 
picture signals. An encoder 2 is fed with a signal output from 
the decoder 1 to compress the information to output the 
information to a sending out transmission channel via an output 
buffer 40. A transcoder control I er 3 has an input buffer monitor 

52 for monitoring the input buffer 21 of the decoder 1, an output 
buffer monitor 62 for monitoring the output buffer 40 of the 
encoder 2, a reception transmission channel monitor 53 for 
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monitoring the state of the reception transmission channel and 
a sending out transmission channel monitor 63 formonitoring the 
state of the sending out transmission channel. There is also 
provided a quantization step controller 73 for variably 
controlling the quantization step in the quantizer 33 of the 
encoder 2 based on the information from the input buffer monitor 
52, output buffer monitor 62, reception transmission channel 
monitor 53 and the sending out transmission channel monitor 63. 
[00443 

Referring to Fig. 4, an encoding system conversion device 
for converting a signal encoded in one encoding system into a 
signal of another encoding system, according to a fourth 
embodiment of the present invention, includes a decoder 1 fed 
with a compression-coded signal in an input buffer 21 to decode 
the signal in a variable length decoding unit 22 to output the 
resulting picture signals. An encoder 2 is fed with a signal 
output from the decoder 1 to compress the information to output 
the information to a sending out transmission channel via an 
output buffer 40. A transcoder controller 3 has a decoder mo nitor 
51 for monitoring the VLD unit 22 of the decoder 1, an input 
buffer monitor 52 for monitoring the input buffer 21 of the 
decoder 1, an output buffer monitor 62 for monitoring the output 
buffer 40 of the encoder 2, a reception transmission channel 
monitor 53 for monitoring the state of the reception 
transmission channel and a sending out transmission channel 
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monitor 63 for monitoring the state of the sending out 
transmission channel. There is also provided a quantization 
step controller 74 for variably controlling the quantization 
step in the quantizer 33 of the encoder 2 based on the information 
from the decoder monitor 51, input buffer monitor 52, output 
buffer monitor 62, reception transmission channel monitor 53 and 
the sending out transmission channel monitor 63. 
[0045] 

The decoder 1 includes an input buffer 21 fed with a signal 
from the reception side transmission channel, a VLD unit 22 for 
decoding the encoded data from the input buffer 21, a first 
inverse quantizer ( I Q) 23 for inverse quantizing the quantized 
transform coefficients from the VLD unit 22, an IDCT unit 24 fed 
with an output of the first inverse quantizer 23, a first adder 
25 fed at its one input with an output of the IDCT unit 24 and 
a first motion compensation prediction unit 27 fed with the 
encoding parameters from the VLD unit 22 and with the output of 
the VLD unit 22. The encoder 2 includes a second adder 31 fed 
with an output of the first adder 25, a DCT unit 32 for 
transforming an output of the second adder 31, a quantizer (Q) 
33 for quantizing an output of the DCT unit 32, a VLC 39 for 
encoding an output of the quantizer 33, an output buffer 40 fed 
with an output of the quantizer 33 to output to the sending out 
transmission channel, an inverse quantizer 34 for inverse 
quantizing an output of the quantizer 33, an IDCT unit 35 for 
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transformingan output of the inverse quantizer 34, a th i rd adder 
36 fed with an output of the IDCT unit 35 , a second frame memory 
unit 37 fed with an output of the third adder 36 and a second 
motion compensation prediction unit 38 fed with picture signals 
5 from the second frame memory unit 37 and with encodingparameters 
from the first motion compensation prediction unit 27. An 
output 203 from the second motion compensation prediction unit 
38 is fed to the VLC 39 and to the second adder 31, while being 
sent via a switch 41 to the third adder 36. The switch 41 is 

TO off and on for the l-picture (intra-coded picture) and for the 
P-picture (predictive picture) and for the b-picture 
(bidirectional predictive picture), respectively. The second 
adder 31 subtractsO from an output of the first adder 25 if the 
picture is an l-picture, while outputting a difference between 

1 5 the output the first adder 25 and the output of the second motion 
compensation prediction unit 38 if the picture is a P- or B- 
picture. 
[0046] 

Referring to Fig. 5, a code rate conversion device for 
20 converting a signal encoded in one encoding system into a signal 
of another encoding system according to a fifth embodiment of 
the present invention includes a code rate conversion unit 4 
including an input buffer 21 fed from a reception side 
transmission channel with a signal compressed in information 
25 volume, and configured for sending out the picture codes 
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compressed in information volume from an output buffer 40 to a 
sending out side transmission channel, and a transcoder 
controller 3 including an input buffer monitor 52 formonitoring 
the input buffer 21, an output buffer monitor 62 for monitoring 
5 the output buffer 40, and a quantization step controller 71 for 
variably controlling the quantization step in the quantizer (Q) 
82 of the code rate conversion device 4 based on the information 
from the input buffer monitor 52 and the output buffer monitor 
62. 

10 [00473 

Referring to Fig. 6, a code rate conversion device for 
converting a signal encoded in one encoding system into a signal 
of another encoding system according to a sixth embodiment of 
the present invention includes, in addition to the structure 

15 shown in the above-described fifth embodiment, a decoder monitor 
51 owned by the transcoder controller 3 for monitoring the VLD 
unit 22 of the code rate conversion device 4. The quantization 
step controller 72 variably controls the quantization step of 
the code rate conversion device 4 based on the information from 

20 the input buffer monitor 52, output buffer monitor 62 and the 
decoder monitor 51. 
[0048] 

Referring to Fig. 7, a code rate conversion device for 
converting a signal encoded in one encoding system into a signal 
25 of another encoding system according to a seventh embodiment of 
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the present invention includes, in addition to the structure 
shown in the above-described fifth embodiment, a reception 
transmission channel monitor 53 for monitoring the state of the 
reception side transmission channel and a sending out 
5 transmission channel monitor 63 for monitoring owned by the 
transcoder controller 3 for monitoring the state of the sending 
out side transmission channel, with both monitors being owned 
by the transcoder controller 3. The quantization step 
controller 72 variably controls the quantization step of the 
10 code rate conversion device 4 based on the information from the 
i nput buf f er mon i tor 52, output buff er mon i tor 62 and the decoder 
monitor 51. 
[0049] 

Referring to Fig. 8, a code rate conversion device for 
15 converting a signal encoded in one encoding system into a signal 
of another encoding system according to an eighth th embodiment 
of the present invention includes, in addition to the structure 
shown in the above-described fifth embodiment, a decoder monitor 
51 owned by the transcoder controller 3 for monitoring the VLD 
20 unit, a r ecep t i on t r ansm i ss i on channe I mon i tor 53 f or mon i to r i ng 
the state of the reception side transmission channel and a 
sending out transmission channel monitor 63 for monitoring the 
state of the sending out side transmission channel, with both 
monitors being owned by the transcoder controller 3. The 
25 quantization step controller 74 variably controls the 
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quantization step (Q) of the code rate conversion device 4 based 
on the information from the input buffer monitor 52, output 
buffer monitor 62, decoder monitor 51, reception transmission 
channel monitor 53 and the sending out transmission channel 
5 mon i tor 63. 
[00503 

In an preferred embodiment of the present invention, a 
picture code rate conversion device includes a code rate 
conversion unit 4. The code rate conversion unit 4 includes an 

10 input buffer unit 21 for being fed with a signal from a reception 
side transmission channel, a variable length decoding unit (VLD) 
22 for decoding picture codes of said input buffer unit 21, a 
first inverse quantizer (IQ) 23 for quantizing an output of the 
first variable length decoder 22, a first adder 81 on one input 

t5 end of which an output of the first inverse quantizer 23 is fed, 
a quantizer (Q) 82 for quantizing an output of the first a adder 
81, a variable length encoder (VLC) 83 for encoding an output 
of the quant i zer 82 to output an encoded output, an output buffer 
40 fed with an encoded signal output of the variable length 

20 encoder 83 to output a resulting output to a sending out side 
transmission channel, a second inverse quantizer ( I Q) 84 for 
i nverse quant i z i ng an output of the quant i zer (Q) , asecondadder 
85 for subtracting an output of the first adder 81 from an output 
of the second inverse quantizer 84, an i DCT unit 86 fed with an 

25 output of the second adder 85 as an input, a frame memory unit 
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87 fed with and storing an output of the IDCT unit 86, a 
difference calculating unit 88 for taking a difference between 
the current picture output from said variable decoding unit 87 
and a picture one frame before from the frame memory unit 87 and 
5 a DCT unit 89 fed with an output of the difference calculating 
unit 88 as an input. The first adder 81 outputs a value 
corresponding to the output of the first inverse quantizer (IQ) 
23 minus the output of the DCT unit 89. The encoding parameters 
output from the VLD unit 22 are input to the VLC 83. The 
10 quantization step controller 74 of the transcoder controller 3 
variably controls the quantization step of the quantizer (Q) 82. 
[0051] 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In the following, certain preferred embodiments of the 

15 present invention are explained. Fig. 1 shows the structure of 
a first embodiment of the present invention. Referring to Fig. 1, 
the first embodiment of the present invention includes a decoder 
1, an encoder 2 and a transcoder controller 3. The decoder 1 
includes an input buffer 21, a variable length decoder (VLD) 22, 

20 an inverse quantizer ( I Q) 23, an inverse discrete cosine 

transform (IDCT) unit 24, an adder 25, a frame memory 26 and a 

motion compensation prediction unit 27. 

[0052] 

The encoder 2 includes an adder 31, a DCT (discrete cosine 
25 transform) unit32, a quantizer (Q) 33, an i nverse quant i zer ( I Q) 
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unit 34, an inverse discrete cosine transform (IDCT) unit 35, 
an adder 36, a frame memory unit 37, a motion compensation 
prediction unit 38, a variable length encoder (VLC) 39, and an 
output buffer 40. 
5 [0053] 

The transcoder controller 3 includes an input buffer 
monitor 52, an output buffer monitor 62, and a quantization step 
con t ro I I e r 71 . 
[0054] 

10 The decoder 1 and the encoder 2 decodes and encodes, 

respectively, in accordance with pre-existing encoding systems, 

such as H. 261, H. 263, or MPEG 1 , 2 or 4. 

[0055] 

Referring to Fig. 1, the operation of the first embodiment 
15 of the present invention is explained in detail. First, the 
operation of the decoder 1 is explained. 
[0056] 

The input buffer 21 stores a bitstream fed from an external 
transmission channel to output a stored bitstream to the VLD 22, 
20 while outputting the information 101 stored in the input buffer 
to the input buffer monitor 52. 
[0057] 

The VLD unit 22 entropy-decodes the output bitstream from 
the input buffer 21, such as by variable length decoding or 
25 run-length decoding, to output the decoded quantized transform 
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- coefficients to the IQ unit 23. On the other hand, the VLD 22 
outputs encoding parameters 201, such as motion vector or the 
prediction mode, to the motion compensation prediction unit 27. 
[00581 

5 The IQ unit 23 inverse-quantizes quantized transform 

coefficients, output from the VLD unit 22, to output the 
inverse-quantized transform coefficients to the IDCT unit 24. 
[0059] 

The IDCT unit 24 performs matrix calculations of inverse 
10 discrete transform on the transform coefficients output from the 
IQ unit 23 to output the transformed picture signals to the adder 
25. 

[0060] 

The adder 25 sums a signal from the IDCT unit 24 and a 
15 picture signal output from the motion compensation prediction 
unit 27 as later explained to output a sum signal to the frame 
memory 26 and to an adder 31 of the encoder 2. 
[0061] 

The frame memory 26 saves the picture signals output from 
20 the adder 25. 
[0062] 

The motion compensation prediction unit 27 performs motion 
compensation prediction, using the encoding parameters 201 
output from the VLD unit 22 and the picture signals stored in 
25 the frame memory 26, to output the resulting picture signals to 
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the adder 25. 
[0063] 

On the other hand, encoding parameters 202 are output to 
the motion compensation prediction unit 38 of the encoder 2. 
5 [0064] 

The operation of the encoder 2 is now explained. 
[0065] 

If the picture is a P- or B-picture, the adder 31 outputs 
picture signals corresponding to the sum of the picture signals 
TO output from the adder 25 and a prediction signal output from the 
motion compensation prediction unit 38, whereas, if the picture 
is an |-picture, the adder 31 directly outputs picture signals 
output from the adder 25. 
[0066] 

15 The DCT unit 32 executes DCT matrix calculations 

(processing) on input picture signals to output the transform 

coefficients to the quantizer (Q) 33. 

[0067] 

The quantizer 33 performs quantization calculations on 
20 transform coefficients output from the DCT unit 32 to output the 
resulting quantized transform coefficients to the VLC unit 39 
and to the inverse quantizer 34. 
[0068] 

It is noted that quantization characteristics are 
25 determined by the quantization step information 103 output from 
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the quantization step controller 71. 
[0069] 

The inverse-quantizer (IQ) 34 inverse-quantizes quantized 
transform coefficients output from the quantizer (Q) 33 to 
5 output the resulting transform coefficients to the IDCT unit 35. 
[0070] 

The IDCT unit 35 perforins IDCT matrix calculations on the 
transform coefficients output from the inverse-quantizer 34 to 
output picture signals corresponding to predicted error signals 
10 and those corresponding to the encoded picture signals to the 
adder 36 in case of the P- and B-pictures and in case of the 
I -p i c tu re, respect i ve I y. 
[0071] 

The adder 36 outputs a signal corresponding to a sum of the 
15 picture signals output from the IDCT unit 35 and the predicted 
error signals in case of P- and B-pictures, whereas outputting 
the picture signals unchanged to the frame memory unit 37 in case 
of I -p i cture. 
[0072] 

20 The frame memory unit 37 stores the picture signals output 

from the adder 36. 
[0073] 

Using the encoding parameters 202 output from the motion 
compensation prediction unit 27 and the picture signals saved 
25 in the frame memory 37, the motion compensation prediction unit 
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38 performs motion detection and motion compensation prediction 
to generate motion compensated prediction picture signals which 
are output to the adders 31 and 36. The encoding parameters 203 
are also output to the VLC unit 39. 
5 [0074] 

The VLC unit 39 applies entropy encoding, such as VLC or 
run-length coding, to the quantized transform coefficients 
output from the quantizer 33 and the encoding parameters 203 
output from the motion compensation prediction unit 38 to output 
tO the resulting encoded signals to the output buffer 40. 
[0075] 

The output buffer 40 stores the encoded signals output from 
the VLC unit 39 to send the encoded signals to outside the 
apparatus. 
T5 [0076] 

The operation of the transcoder controller 3 is now 
explained. 
[0077] 

The input buffer monitor 52 monitors the storage volume in 
20 the input buffer 21 of the decoder 1 to output the input buffer 
information 107 to the quantization step controller 71. 
[0078] 

The output buffer monitor 62 monitors the stored output 
buffer volume of the output buffer 40 in the encoder 2 to output 
25 the output buffer information 109 to the quantization step 
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con t ro I I er 71 . 
[0079] 

Based on the input buffer information 107 and on the output 
buffer information 109, the quantization step controller 71 of 
5 the transcoder controller 3 determines the quantization step 
information 103 which is delivered to the quantizer (Q) 33 of 
the encoder 2. 
[0080] 

The quantization step controller 71 continually monitors 
10 the output buffer information 109 and, should there be produced 
overflow in the output buffer 40, the quantization step 
information 103 is modified to diminish the code volume produced 
in the encoder 2 to prevent overflow from occurring in the output 
buffer 40. 
15 [0081] 

Should there be produced or expected underflow in the 
output buffer 40, the quantization step information 103 is 
modified to increase the volume of codes produced in the encoder 
2 to prevent the underflow in the output buffer 40. This evades 
20 the output buffer 40 from being destroyed or running into fai lure 
or. 

[0082] 

It is also possible for the quantization step controller 
71 to set the target storage volume in the output buffer 40 to 
25 determine the quantization step information 103 based on the 
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relative magnitude of the output buffer information 109 as the 

actual storage volume and the target storage volume. 

[0083] 

If the actual storage volume is larger than the target 
5 storage volume, the quantization step information 103 is 
modified to decrease the volume of the codes generated in the 
encoder 2, that is for increasing the quantization step. 
[0084] 

If, conversely, the storage volume is smaller than the 
10 target storage volume, the quantization step information 103 is 
modified to increase the code volume generated in the encoder 
2, that is to decrease the quantization step. 
[0085] 

The target value can be variably set instead of being a 
15 fixed value. It is also possible to set the upper and lower 
limit target values and to set the target value within a certain 
preset range. 
[0086] 

The quantization step controller 71 is able to calculate 
20 the code volume per processing unit from the input buffer 
information 107 and the output buffer information 109 in 
effecting picture coding system conversion. 
[0087] 

Now considering the processing unit based pre- and 
25 post-conversion code volumes in case of performing the picture 
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encoding system conversion, if the pre-convers i on code volume 
is larger than the post-conversion code volume, the band of the 
transmission channel transmitting the bitstreatn would be not 
fully utilized. If, conversely, the post-conversion code 
5 volume is larger than the pre-convers i on code volume, the 
bitstream cannot be sent with the band of the transmission 
channel sending out the bitstream, thus causing delay at the 
output buffer. 
[0088] 

10 That is, if the pre-convers ion code volume is coincident 

with the post-conversion code volume, the most effective 
utilization of the band of the transmission channel and the time 
delay are reduced, provided, however, that this is applicable 
to a case where the band of the transmission channel for the input 

15 bitstream is the same as that of the transmission channel for 
the output b i tstream. 
[0089] 

If both the bands are different, the post-conversion code 
volume is preferably coincident with a pre-conversion code 
20 volume multiplied with a ratio R which is a ratio between the 
input transmission channel band and the output transmission 
channel band, e.g., a ratio R of the input band to the output 
band. 
[0090] 

25 Thus, with the quantization step controller 71, effective 
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utilization of the transmission channel and reduction in the 
time delay may be realized by determining the quantization step 
depending on the difference between the processing unit based 
pre-convers ion code volume and the pos t -con ve r s i on code volume 
5 in converting the picture encoding system. 
[0091] 

If, for example, the p re-conve r s i on code volume is larger 
than the post-conversion code volume, the quantization step 
information 103 is modified (or modulated) to increase the code 
-10 volume generated in the encoder 2 at the next processing. 
[0092] 

If, conversely, the pre-convers i on code vo I ume i s I ess than 
the post-conversion code volume, the quantization step 
information 103 is modified (or modulated) to decrease the code 
15 volume generated in the encoder 2 at the next processing. 
[0093] 

In this manner, it becomes possible to determine the 
processing unit based quantization step in converting the 
picture encoding system. 
20 [0094] 

As a method for converting the picture encoding system, it 
is possible to use any of the quantization step modifying systems, 
such H. 261, H. 263, or MPEG 1, 2 or 4, which belong to the 
conventional picture encoding systems. 
25 [0095] 
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A second embodiment of the present invention is hereinafter 
explained. Fig. 2 shows the structure of the second embodiment. 
Referring to Fig. 2, the second embodiment of the present 
invention includes, in addition to the components of the first 
5 embodiment, a decoder monitor 51, owned by the transcoder 
controller 3, for monitoring the VLC unit 22. A quantization 
step controller 72 determines the quantization step information 
using the input buffer monitor 52, output buffer monitor 62 and 
the decoder mon i tor 51. 
10 [0096] 

That is, referring to Fig. 2, the present second embodiment 
includes a decoder 1, an encoder 2 and a transcoder controller 
3. The decoder 1 is made up of an input buffer 21, a VLD unit 
22, an inverse-quantizer 23, an I DCT unit 24, an adder 25, a frame 

15 memory 26 and a motion compensation prediction unit 27. The 
encoder 2 is made up of an adder 31, a DCT unit 32, a quantizer 
33, an inverse-quantizer 34, an IDCT unit 35, an adder 36, a frame 
memory unit 37, a motion compensation prediction unit 38, a VLC 
unit 39 and an output buffer 40. The a transcoder controller 

20 3 is made up of an input buffer monitor 52, an output buffer 
monitor 62 and a quantization step controller 72. 
[0097] 

Referring to Fig. 2, the operation of the second embodiment 
of the present invention is explained in detail. 
25 [0098] 
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In addition to the operation of the above-described first 
embodiment, the operation of the decoding unit 1 includes the 
operation of the VLD unit 22 outputting encoding parameters 102 
to the decoder monitor 51 of the transcoder controller 3. The 
5 operation of the encoder 2 is similar to that of the previous 
first embod i men t. 
[0099] 

The operation of the transcoder controller 3 is now 
exp I a i ned. 
10 [0100] 

The decoder monitor 51 monitors the VLD unit 22 of the 
decoder 1 and outputs encoding parameters 108 to the 
quantization step controller 72. 
[0101] 

15 The input buffer monitor 52 monitors the stored input 

buffer volume in the input buffer 21 to output the input buffer 
information 107 to the quantization step controller 72. 
[0102] 

The output buffer monitor 62 monitors the stored output 
20 buffer volume in the output buffer 40 of the encoder 2 to output 
the output buffer information 109 to the quantization step 
controller 72. 
[0103] 

The transcoder controller 3 determines the quantization 
25 step information 103 based on the input buffer information 107 
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and the output buffer information 109 to deliver the so- 
determined information to the quantizer (Q) 33 of the encoder 
2. 

[01043 

5 The transcoder controller 3 is also able to determine the 

quantization step information 103 by referencing also the 
encod i ng pa rameters 1 08. 
[0105] 

The quantization step controller 72 monitors the output 
10 buffer information 109, such that, i f ove r f I ow wou I d be p roduced 
in the output buffer 40, the quantization step controller 72 
causes the quantization step information 103 to decrease the 
code volume generated in the encoder 2 to prevent overflow from 
occurring in the output buffer 40. 
15 [0106] 

If underflowwould be produced in the output buffer 40, the 
quantization step information 103 is modified to increase the 
volume of codes generated in the encoder 2 to prevent underflow 
of the output buffer 40. This prevents the output buffer 40 from 
20 failure. 
[0107] 

It is possible for the quantization step controller 72 to 
set the target storage volume in the output buffer 40 to 
determine the quantization step information 103 based on the 
25 relative magnitudes between the output buffer information 109 
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as the actual storage volume and the target storage volume. 
[0108] 

If the actual storage volumewould become or is larger than 
the target storage volume, the quantization step information 103 
5 is modified to decrease the volume of the codes generated in the 
encoder 2, that is to increase (or enlarge) the quantization 
step. 
[0109] 

If, conversely, the actual storage volume is smaller than 
iO the target storage vo I ume, the quant i zat i on step i nf ormat i on 1 03 
is modified to increase the volume of the codes generated in the 
encoder 2, that is to decrease (or shorten) the quantization 
step. 
[0110] 

15 The target value can be variably set instead of being a 

fixed value. It is also possible to set the upper and lower 
limit target values and to set the target value within a certain 
preset range. 
[0111] 

20 The quantization step controller 72 calculates the code 

volume per processing unit based on the input buffer information 
107 and the output buffer information 109 in effecting picture 
coding system conversion. 
[0112] 

25 Now considering the processing unit based pre- and 
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post-conversion code volumes in case of performing the picture 
encoding system conversion, if the pre-convers i on code volume 
is larger than the post-conversion code volume, the band of the 
transmission channel transmitting the bitstream is not fully 
utilized. If, conversely, the p r e-conve r s i on code volume is 
smaller than the post-conversion code volume, the bitstream 
cannot be sent with the band of the transmission channel sending 
out the bitstream, thus causing delay at the output buffer. 
[0113] 

That is, if the pre-convers i on code volume is coincident 
with the post-conversion code volume, the effective utilization 
of the band of the transmission channel is achieved, and time 
delay is reduced, provided, however, that this is appticable to 
a case where the band of the transmission channel for the input 
bitstream is the same as that of the transmission channel for 
the output b i tst ream. 
[0114] 

That is, if the bands would differ, the post-conversion 
code volume is desi rab I y coincident wi th the pre-convers i on code 
volume multiplied with a ratio R which is a ratio between the 
input transmission channel band and the output transmission 
channel band. 
[0115] 

In the transcoder controller 3, effective utilization of 
the transmission channel band and reduction in the delay time 
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can be realized by determining the quantization step depending 
on the difference between the processing-unit-based pre- 
conversion code volume and the processing-unit-based post- 
conversion code volume as at the time of performing the picture 
5 encoding system conversion. 
[0116] 

For example, if the pre-conversion code volume would become 
or is larger than the post-conversion code volume, the 
quantization step information 103 is modified such as to 

tO increase the code volume generated in the encoder 2 at the time 
of the next processing. If, conversely, the pre-conversion code 
volume would become or is smaller than the post-conversion code 
volume, the quantization step information 103 is modified such 
as to decrease the code volume generated in the encoder 2 at the 

t5 time of the next processing. This allows to determine the 
quantization step per processing unit in converting the picture 
encoding system. 
[0117] 

In the second embodiment of the present invention, the 
20 quantization step information 103 is determined (additionally) 
using the encoding parameters 108 output from the decoder 
monitor at the time of determining the quantization step. The 
reason is that, taking the picture quality following the 
conversion of the picture encoding system into consideration, 
25 the pre-conversion code volume can be equated to the post- 
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conversion code volume by performing the encoding using the 
quantization step obtained in the decoder 1 in performing the 
quantization in the encoder 2 . 
[0118] 

5 If a quantization step used in decoding significantly 

differs from a quantization step used in encoding, picture 
distortion tends to be produced. 
[0119] 

The picture quality can be improved by determining the 
10 quantization step information 103 with the aid of the encoding 
parameters 108 output from the decoder monitor 51. Control may 
be managed by performing fine adjustment, depending on the 
output buffer 40, pre-convers i on code volume and on the 
post-conversion code volume, using the quantization step output 
15 from the decoder monitor 51 as an initial value. 
[0120] 

As the method for modifying the quantization step, use may 
be made of any of conventional picture encoding systems, such 
as the quantization step modifying systems, e. g. , H. 261, H. 263, 
20 or MPEG1, 2 or 4. 
[0121] 

A third embodiment of the present invention is now 
explained. F i g. 3 shows the configuration of the third 
embodiment of the present invention. Referring to Fig. 3, the 
25 third embodiment of the present invention includes, in addition 
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to the components of the first embodiment, a reception side 
transmission channel monitor ("reception channel monitor") 53 
for monitoring the reception side transmission channel and a 
sending out side transmission channel monitor 63 for monitoring 
the sending out side transmission channel, these monitors 53, 
63 being provided in the transcoder controller 3. The 
quantization step controller 73 determines the quantization 
step information using the information output from the input 
buffer monitor 52, output buffer monitor 62, reception side 
transmission channel monitor 53 and from the sending out side 
transmission channel monitor 63. 
[0122] 

That is, referring to Fig. 3, the present third embodiment 
includes decoder 1, encoder 2 and transcoder control I er 3. The 
decoder 1 is made up of an input buffer 21, a VLD unit 22, an 
inverse-quantizer 23, an IDCT unit 24, an adder 25, a frame 
memory 26 and a motion compensation prediction unit 27. The 
encoder 2 is made up of an adder 31, a DCT unit 32, a quantizer 
33, an i nverse-quant i zer 34, an I DCT un i t 35, an adder 36, a frame 
memory unit 37, a motion compensation prediction unit 38, a VLC 
unit 39 and an output buffer 40. The transcoder controller 3 
is made up of an input buffer monitor 52, a reception side 
transmission channel monitor 53, an output buffer monitor 62, 
a sending out side transmission channel monitor 63, and a 
quantization step controller 73. 
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[0123] 

Referring to Fig. 3, the operation of the third embodiment 
of the present invention is explained in detail. 
[0124] 

The description for the operation of the decoder 1 and the 
encoder 2 is omitted because it is the same as that of the 
above-described first embodiment. 

The operation of the transcoder controller 3 is now explained. 
[0125] 

The reception side transmission channel monitor 53 
monitors the state of the transmission channel over which the 
input bitstream is transmitted to output the sending out side 
reception channel information 111 to the quantization step 
controller 73. 
[0126] 

The sending out side transmission channel monitor 63 
monitors the state of the transmission channel over which the 
output bitstream is transmitted to output the sending out side 
transmission channel information 112 to the quantization step 
controller 73. 
[0127] 

The input buffer monitor 52 monitors the storage volume of 
the input buffer 21 of the decoder 1 to output the sending out 
side transmission channel information 112 to the quantization 
step contro I I er 73. 
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[0128] 

The output buffer monitor 62 monitors the storage volume 
of the output buffer 40 of the encoder 2 to output the output 
buffer information 109 to the quantization step controller 73. 
5 [0129] 

The transcoder controller 3 determines the quantization 
step information 103, based on the input buffer information 107 
and the output buffer information 109, to deliver the resulting 
quantization step information 103 to the quantizer 33 of the 
10 encoder 2. 
[0130] 

The reception side transmission channel information 111 
and the sending out side transmission channel information 112 
may also be referenced in determining the quantization step 
15 information 103. 
[0131] 

The quantization step controller 73 monitors the output 
buffer information 109, such that, if overflow would occur in 
the output buffer 40, the quantization step information 103 is 
20 modified to reduce the volume of the codes generated in the 
encoder 2 to prevent overflow from occurring in the output buffer 
40. 

[0132] 

On the other hand, if underflow would occur in the output 
25 buffer 40, the quantization step information 103 is modified to 
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increase the volume of the codes generated in the encoder 2 to 
prevent underflow from occurring in the output buffer 40. 
[0133] 

This prevents the failure in operation from occurring in 
5 the output buffer 40. 
[0134] 

It is also possible for the quantization step controller 
73 to set the target storage volume in the output buffer 40 to 
determine the quantization step information 103 from the 
10 relative magnitude of the output buffer information 109 as the 
actual storage volume and the target storage volume. 
[0135] 

If the actual storage volume is larger than the target 
storage volume, the quantization step information 103 is 
15 modified to decrease the volume of the codes generated in the 
encoder 2. 
[0136] 

That is, adjustment is made for increasing the quantization 

step. 
20 [0137] 

If, conversely, the storage volume is smaller than the 
target storage volume, the quantization step information 103 is 
modified to increase the code volume generated in the encoder 
2. 

25 [0138] 
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That is, adjustment is made for decreasing the quantization 

step. 
[0139] 

The target value can be variably set instead of being a 
5 fixed value. 
[0140] 

It is also possible to set the upper and lower limit target 
values and to set the target value within a certain preset range. 
[0141] 

^10 The quantization step controller 73 calculates the code 

volume per processing unit (i.e., unit by unit) based on the 
input buffer information 107 and the output buffer information 
109 in effecting picture coding system conversion. 
[0142] 

15 Now, considering the processing-unit-based pre- and 

post-conversion code volumes in case of performing the picture 
encoding system conversion, if the pre-convers i on code volume 
would become larger than the post-conversion code volume, the 
band of the transmission channel transmitting the bitstream is 

20 not fully un i I i zed. 
[0143] 

If, conversely, the pre-convers i on code volume is smaller 
than the post-conversion code volume, the bitstream cannot be 
sent with the band of the transmission channel sending out the 
25 bitstream, thus causing delay at the output buffer. 
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[0144] 

That is, if the pre-conversion code volume is coincident 
with the post-conversion code volume, the most effective 
utilization of the band of the transmission channel and reduced 
5 time delay can be achieved. 
[0145] 

The premise for this is that this is that the band of the 
transmission channel for the input bitstream is controlled to 
be the same as that of the transmission channel for the output 
10 b i ts t ream. 
[0146] 

That is, if the both bands would differ, the post- 
conversion code volume is desirably coincident with the pre- 
conversion code volume multiplied with a ratio R between the 
15 input transmission channel band and the output transmission 
channel band. 
[0147] 

The ratio R between the input transmission channel band and 
the output transmission channel band can be calculated from the 
20 reception side transmission channel information 111 and the 
sending out side transmission channel information 112. 
[0148] 

If both the input transmission channel and the output 
transmission channel are at the CBR (constant bit rate), that 
25 is the fixed transmission rate, the ratio R is constant, whereas, 
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if one of them is at VBR (variable bit rate), that is at a variable 

transmission rate, the ratio R is variable. 

[0149] 

So, in the quantization step controller 73, effective 
5 utilization of the transmission channel band and reduction in 
the delay time can be realized by determining the quantization 
step depending on the difference between the processing- 
unit-based p r e-conve r s i on code volume and the processing- 
unit-based post-conversion code volume as at the time of 
10 performing the picture encoding system conversion. 
[01 50] 

For example, if the p r e-conve rs i on code volume is larger 
than the post-conversion code volume, the quantization step 
information 103 is modified such as to increase the code volume 
15 generated in the encoder 2 at the time of the next processing. 
[0151] 

If, conversely, the p r e-conve rs i on code volume is smaller 
than the post-conversion code volume, the quantization step 
information 103 is modified such as to decrease the code volume 
20 generated in the encoder 2 at the time of the next processing. 
[0152] 

This allows to determine the quantization step per 
processing unit in converting the picture encoding system. 
[0153] 

25 If the transmission channel is at the VBR, and there is 
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certain allowance in the band of the transmission channel, the 
volume of the codes generated in the encoder 2 may be increased 
to achieve the effective band utilization. 
[0154] 

5 If, conversely, there is no allowance in the band of the 

transmission channel, the quantization step information 103 is 
determined such as to decrease the volume of the codes generated 
in the encoder 3. 
[0155] 

10 As the method for modifying the quantization step, use may 

be made of any of the conventional picture encoding systems, such 
as the quant i zat i on step mod i fy i ng systems, e.g., H . 2 61, H. 263, 
or MPEG 1 , 2 or 4. 
[0156] 

15 A fourth embodiment of the present invention is now 

explained. F i g. 4 shows the configuration of the fourth 
embodiment of the present invention. Referring to F i g. 4, the 
fourth embodiment of the present invention includes, in addition 
to the components of the first embodiment, a decoder monitor 51 

20 for monitoring the reception side transmission channel, a 

reception side transmission channel monitor 53 for monitoring 
the reception side transmission channel and a sending out side 
transmission channel monitor 63 for monitoring the sending out 
side transmission channel, these monitors 51, 53 and 63 

25 belonging to the transcoder controller 3. A quantization step 
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controller 73 determines the quantization step information 
using the information output by the input buffer monitor 52, 
output buffer monitor 62, decoder monitor 51, reception side 
transmission channel monitor 53 and the sending out side 
transmission channel monitor 63. 
[0157] 

That is, referring to Fig. 4, the present third embodiment 
includes decoder 1, encoder 2 and transcoder 3. The decoder 1 
is made up of an input buffer 21, a VLD unit 22, an inverse- 
quantizer 23, an IDCT unit 24, an adder 25, a frame memory 26 
and a motion compensation prediction unit 27. The encoder 2 is 
made up of an adder 31, a DCT unit 32, a quantizer 33, an 
inverse-quantizer 34, an IDCT unit 35, an adder 36, a frame 
memory unit 37, a motion compensation prediction unit 38, a VLC 
unit 39 and an output buffer 40. The transcoder controller 3 
is made up of a decoder monitor 51, an input buffer monitor 52, 
a reception side transmission channel monitor 53, a sending out 
side transmission channel monitor 63, an output buffer monitor 
62 and a quantization step controller 74. 
[01 58] 

Since the operation of the decoder 1 is the same as that 
of the second embodiment, while the operation of the encoder 2 
is the same as that of the first embodiment, the corresponding 
explanation is omitted for simplicity. 
[0159] 
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The operation of the transcoder controller 3 is now 
exp I a i ned. 
[0160] 

The reception side transmission channel monitor 53 
monitors the state of the transmission channel over which the 
input bitstream is transmitted to output the reception side 
transmission channel information 111 to the quantization step 
controller 74. 
[0161] 

The sending out side transmission channel monitor 63 
monitors the state of the transmission channel over which the 
output bitstream is transmitted to output the sending out side 
transmission channel information 112 to the quantization step 
controller 74. 
[0162] 

The decoder monitor 51 monitors the VLD unit 22 of the 
decoder 1 to output the encoding parameters 108 to the 
quantization step controller 72. 
[0163] 

The input buffer monitor 52 monitors the storage volume of 
the input buffer 21 of the decoder 1 to output the input buffer 
information 107 to the quantization step controller 74. 
[0164] 

The output buffer monitor 62 monitors the storage volume 
of the output buffer 40 of the encoder 2 to output the output 
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buffer information 109 to the quantization step controller 74. 
[0165] . 

The transcoder controller 3 determines the quantization 
step information 103, primarily based on the input buffer 
5 information 107 and the output buffer information 109, to 
deliver the resulting quantization step information 103 to the 
quantizer (Q) 33 of the encoder 2. 
[0166] 

The reception side transmission channel information 111 
-10 and the sending out side transmission channel information 112 
may also be referenced in determining the quantization step 
information 103. 
[0167] 

The quantization step controller 74 monitors the output 
15 buffer information 109, such that, if overflow occurs in the 
output buffer 40, the quantization step information 103 is 
modified to reduce the volume of the codes generated in the 
encoder 2 to prevent overflow from occurring in the output buffer 
40. 

20 [0168] 

On the other hand, if underflow occurs in the output buffer 
40, the quantization step information 103 is modified to 
increase the volume of the codes generated in the encoder 2 to 
prevent underflow from occurring in the output buffer 40. 
25 [0169] 
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This prevents the failure in operation from occurring in 
the output buffer 40. 
[0170] 

It is also possible for the quantization step controller 
74 to set the target storage volume in the output buffer 40 to 
determine the quantization step information 103 from the 
relative magnitude of the output buffer information 109 as the 
actual storage volume and the target storage volume. 
[0171] 

If the actual storage volume is larger than the target 
storage volume, the quantization step information 103 is 
modified such as to decrease the volume of the codes generated 
in the encoder 2. 
[0172] 

If, conversely, the storage volume is smaller than the 
target storage volume, the quantization step information 103 is 
modified such as to increase the code volume generated in the 
encoder 2. 
[0173] 

The target value can be variably set instead of being a 
fixed value. 
[0174] 

It is also possible to set the upper and lower limit target 
values and to set the target value within a certain preset range. 
[0175] 
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The quantization step controller 74 is able to calculate 
the code volume per processing unit based on the input buffer 
information 107 and the output buffer information 109 in 
effecting picture coding system conversion. 
[0176] 

Now let's consider the processing-unit-based pre- and 
post-conversion code volumes in case of performing the picture 
encoding system conversion. If the pre-convers i on code volume 
would become larger than the post-conversion code volume, the 
band of the transmission channel transmitting the bitstream 
wou Id be not fully ut i I i zed. 
[0177] 

If, conversely, the p re-con ve rs i on code volume is smaller 
than the post-conversion code volume, the bitstream cannot be 
sent with the band of the transmission channel sending out the 
bitstream, thus causing delay at the output buffer. 
[0178] 

That is, if the p re-conve r s i on code volume is coincident 
with the post-conversion code volume, the most effective 
utilization of the band of the transmission channel and reduced 
time delay can be achieved. 
[0179] 

The premise for this is that this is that the band of the 
transmission channel for the input bitstream is the same as that 
of the transmission channel for the output bitstream. 
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[0180] 

That is, if both the bands differ, the post-conversion code 
volume should be desirably coincident with the p r e-conve r s i on 
code volume multiplied with a ratio R between the input 
5 transmission channel band and the output transmission channel 
band. 
[0181] 

The ratio R between the input transmission channel band and 
the output transmission channel band can be calculated from the 
10 reception side transmission channel information 111 and the 
sending out side transmission channel information 112. 
[0182] 

If both the input transmission channel and the output 
transmission channel are at the CBR (constant bit rate), that 
15 i s the f i xed t ransm i ss i on rate, the rat i o R i s constant, whereas, 
if oneof them is at VBR (variable bit rate), that is at a variable 
transmission rate, the ratio R is variable. 
[0183] 

In the quantization step controller 74, effective 
20 utilization of the transmission channel band and reduction in 
the delay time can be realized by determining the quantization 
step depending on the difference between the processing- 
unit-based p re-conve r s i on code volume and the processing- 
unit-based post-conversion code volume as at the time of 
25 performing the picture encoding system conversion. 
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[0184] 

For example, if the p re-con ve rs i on code volume is larger 
than the post-conversion code volume, the quantization step 
information 103 is modified such as to increase the code volume 
5 generated in the encoder 2 at the time of the next processing. 
[0185] 

If, conversely, the p r e-conve rs i on code volume is smaller 
than the post-conversion code volume, the quantization step 
information 103 is modified such as to decrease the code volume 
10 generated in the encoder 2 at the time of the next processing. 
[0186] 

This allows to determine the quantization step per 
processing unit in converting the picture encoding system. 
[0187] 

t5 If the transmission channel is at the VBR, and there is 

certain allowance in the band of the transmission channel, the 
volume of the codes generated in the encoder 2 may be increased 
to achieve the effective band utilization. 
[0188] 

20 If, conversely, there is no allowance in the band of the 

transmission channel, the quantization step information 103 is 
determined such as to decrease the volume of the codes generated 
in the encoder 3. 
[0189] 

25 The quantization step information 103 may also be 
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determined using the encoding parameters 108 output from the 
decoder monitor in determining the quantization step. 
[0190] 

The reason is that, taking the picture quality following 
5 the conversion of the picture encoding system, the pre- 
conversion picture properties can be equated to the post- 
conversion picture properties by performing the encoding using 
the quantization step obtained in the decoder 1 in performing 
the quantization in the encoder 2. 
10 [0191] 

If the quantization step used in decoding significantly 
differs from the quantization step used in encoding, picture 
distortion tends to be produced. 
[0192] 

15 The picture quality can be improved by determining the 

quantization step information 103 with the aid of the encoding 
parameters 108 output from the decoder monitor 51. 
[0193] 

That is, control may be managed by performing fine 
20 adjustment, depending on the output buffer 40, p re-con ve r s i on 
code volume and on the post-conversion code volume, using the 
quantization step output from the decoder monitor as an initial 
value. 
[0194] 

25 As the method for modifying the quantization step, use may 
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be made of any of the conventional picture encoding systems, such 
as the quantization step modifying systems, e. g. , H. 261, H. 263, 
or MPEG1, 2 or 4. 
[0195] 

5 Fig. 9 is a flow diagram showing a typical operation of the 

quantization step controller 74 in the fourth embodiment of the 
present i nven t i on. 
[0196] 

At step A1, the quantization step is provisionally 
10 determined by the decoder operation information 102. 
[0197] 

At step A2, the target code (generation) volume is set from 
the input buffer information 107 based on the pre-convers i on 
code volume per encoding system conversion processing unit. 
-15 [0198] 

At step A3, it is verified whether or not the stored volume 
of the output buffer is within the target range. If the stored 
volume is within the target range, the quantization step 
controller 74 proceeds to step A4. 
20 [0199] 

If the storage volume of the output buffer is verified at 
step A3 to be outside the target range, the quantization step 
controller 74 proceeds to step B1 top B4, depending on the 
storage volume. 
25 [0200] 
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At step A4, the quantization step Q is changed (modified) 
depending on the target code volume. 
[02013 

The quantization step information 103 is output at this 
time to the quantizer 33 of the encoder 2. 
[0202] 

At step A5, the encoder 2 performs encoding using the 
quantization step information 103 mentioned above. 
[0203] 

At step A6, the volume of the actually produced codes is 
determined from the output buffer information 109 to update the 
target code volume of the generated codes. 
[02041 

If, at step A7, the end cond i t i on i s not met, the p rocess i ng 
reverts to step A1 making up a loop. 
[0205] 

If, at step A3, the storage volume of the output buffer is 
outside the target range (NO), processing branches to step B1 
(overflow), step B2 (the storage volume being larger than the 
lower target value), step B3 (the storage volume being smaller 
than the upper target value) or to step B4 (underflow), depending 
on the stored volume of the output buffer. At steps B1 and B2, 
the processing transfers to step C 1 to increase the quantization 
step Q, whereas, at steps B3 and B4, the processing transfers 
to step C2 to decrease the quantization step Q before 
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transf err i ng to step A5. 
[02063 

A fifth embodiment of the present invention is hereinafter 
explained. F i g. 5 shows the configuration of a code rate 
conversion device according to the fifth embodiment of the 
present invention. 
[0207] 

Referring to Fig. 5, the fifth embodiment of the present 
invention includes a code rate conversion device 4 and a 
transcoder controller 3. The code rate conversion device 4 is 
made up of an input buffer 21, a variable length decoding (VLD) 
unit 22, an inverse-quantizer (IQ) 84, an adder 85, an inverse 
discrete cosine transform UDCT) unit 86, a frame memory 87, a 
difference calculating unit (ADDER) 88 and a discrete cosine 
transform (DCT) unit 89. The transcoder controller 3 is made 
up of an input buffer monitor 52, an output buffer monitor 62 
and a quantization step controller 71. 
[0208] 

Referring to Fig. 5, the operation of the code rate 
conversion device, according to the fifth embodiment of the 
present invention, is explained in detail. 
[0209] 

First, the operation of a code rate conversion device 5 is 
explained. 
[0210] 
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The input buffer 21 stores the bitstream, supplied thereto 
from outside, to output the stored bitstream to the VLD unit 22. 
[02113 

On the other hand, the input buffer monitor 52 is fed with 
5 the input buffer storage information 101. 
[0212] 

The VLD unit 22 performs entropy decoding, such as variable 
length decoding or run-length decoding, on the bitstream output 
from the input buffer 21, to output decoded quantization 
10 transform coefficients to the inverse-quantizer (IQ1 23. 
[02133 

The encoding parameters 201, such as the motion vector or 
the prediction mode, are sent to the difference calculating unit 
88 and to the VLC un i t 83. 
15 [02143 

The inverse-quantizer 23 inverse-quantizes the quantized 
transform coefficients output from the VLD unit 22 to output the 
inverse-quantized transform coefficients. 
[02153 

20 The IDCT unit 24 performs IDCT matrix processing 

(calculations) coefficients on the transform coefficients 
output from the 1Q unit 23 to output the transformed picture 
signals to the adder 81. 
[02163 

25 The adder 81 sums the signal output from the inverse- 
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quantizer 23 and an output of the DCT unit 89 to output a 
resulting sum to the quantizer (Q) 82 and to the adder 85. 
[0217] 

The quantizer 82 quantizes the transform coefficients 
5 output from the adder 81 to output resulting quantized transform 
coefficients to the VLC unit 83 and to the inverse-quantizer ( I Q) 
84. 

[0218] 

The VLC unit 83 performs entropy decoding, such as variable 
10 length decoding or run-length decoding, on the quantized 

transform coefficients output from the quantizer 82, and on the 
encoding parameters 201, output from the VLD unit 22, to output 
the resulting encoded signals to the output buffer 40. 
[0219] 

15 The inverse-quantizer (IQ) 84 inverse-quantizes the 

quantized transform coefficients, output from the quantizer 82, 
to output the resulting transform coefficients to the adder 85. 
[0220] 

The adder 85 sums the transform coefficients, output from 
20 the inverse-quantizer 84, and the transform coefficients output 
from the adder 81, more specifically, negative values thereof, 
to output a resulting sum to the IDCT unit 86. 
[0221] 

The IDCT 86 performs IDCT matrix calculations on the 
25 transform coefficients output from the adder 85 to output 
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resulting picture signals to the frame memory 87. 
[0222] 

The frame memory 87 stores the picture signals output from 
the IDCT unit 86. 
5 [0223] 

The difference calculating unit (ADDER) 88 calculates the 
difference between a picture one frame before and the current 
picture to output the resulting difference to the DCT unit 89. 
[0224] 

10 The DCT unit 89 performs DCT matrix calculations on the 

difference data output from the difference calculating unit 88 
to output the resulting transform coefficients to the adder 81. 
[0225] 

f The output buffer 40 stores the encoded signals, output 

15 from the VLC unit 83, to send out the encoded signals to outside 
the device. 
[0226] 

The operation of the transcoder controller 3, having an 
input buffer monitor 52, an output buffer monitor 62 and a 
20 quant i zat ion step control I er 71, and con f i gu r ed f o r con t ro I I i ng 
the quantization step of the quantizer 82 by the quantization 
step controller 71, is similar to that of the above-described 
first embodiment and hence is not explained specifically. 
[0227] 

25 A sixth embodiment of the present invention is now 
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explained. F i g. 6 shows the s t r uc tu r e of a code r a t e con ve r s i on 
device according to the sixth embodiment of the present 
invention. Re f e r r i ng t o F i g. 6, t he p r esen t s i x t h embod i men t o f 
the present invention includes, in addition to the structure of 
5 the above-described fifth embodiment, a decoder monitor 51, 
owned by the transcoder control ler 3, for monitoring the VLD unit 
22, with the quantization step controller 72 determining the 
quantization step information using the information output from 
the input buffer monitor 52, output buffer monitor 62 and decoder 

10 monitor 51. That is, the sixth embodiment of the present 
invention includes a code rate conversion device 4 and a 
transcoder controller 3. The code rate conversion device 4 is 
made up of an i nput buf f er 21, a VLD unit 22, an i nve rse-quan t i ze r 
(IQ) 23, an adder 81, a quantizer 82, a VLC unit 83, an 

T5 inverse-quantizer (IQ) 84, an adder 85, an IDCT unit 86, a frame 
memory 87, a difference calculating unit 88 and a DCT unit 89. 
The transcoder controller 3 is made up of a decoder monitor 51, 
an input buffer monitor 52, an output buffer monitor 62 and a 
quantization step controller 73. 

20 [0228] 

The operation of the code rate conversion device 4 is the 
operation of the fifth embodiment plus the operation of the VLD 
unit 22 outputting the encoding parameters 102 to the decoder 
monitor 51 of the transcoder controller 3. 
25 [0229] 
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The operation of the transcoder controller 3 is similar to 
that of the transcoder controller 3 in the above-described 
second embodiment and hence is not explained specifically. 
[0230] 

5 A seventh embodiment of the present invention is now 

explained. Fig. 7 shows the structure of the code rate 
conversion device according to the seventh embodiment of the 
present invention. Referring to Fig. 7, the present seventh 
embodiment of the present invention includes, in addition to the 

10 structure of the above-described fifth embodiment, a reception 
side transmission channel monitor 53 for monitoring the 
reception side transmission channel, and a sending out side 
transmission channel monitor 63 for monitoring the sending 
transmission channel, both owned by the transcoder controller 

15 3, with the quantization step controller 73 determining the 
quantization step information using the information output from 
the input buffer monitor 52, output buffer monitor 62, reception 
side transmission channel monitor 53 and the sending out side 
transmission channel monitor 63. That is, the sixth embodiment 

20 of the present invention includes a code rate conversion device 
4 and a transcoder controller 3. The code rate conversion 
device 4 is made up of an input buffer 21, a VLD unit 22, an 
inverse-quantizer ( I Q) 23, an adder 81, a quantizer 82, a VLC 
unit 83, an inverse-quantizer ( I Q) 84, an adder 85, an IDCT unit 

25 86, a frame memory 87, a difference calculating unit 88 and a 
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DCT unit 89 The a transcoder control ler 3 is made up of an input 
buffer monitor 52, a reception side transmission channel monitor 
53, an output buff er mon i tor 62, a send i ng ou t s i de t ransm i ss i on 
channel monitor 63, and a quantization step controller 73. 
[0231] 

The operation of the code rate conversion device 4 and the 
operation of the transcoder controller 3 are similar to those 
of the code rate conversion device 5 in the previous fifth 
embodiment, and the transcoder controller 3 in the previous 
third embodiment, respectively, and hence are not explained 
specifically. 
[0232] 

An eighth embodiment of the present invention is now 
explained. F i g. 8 shows the structure of the code rate 
conversion device according to the eighth embodiment of the 
present invention. Referring to Fig. 8, the present eighth 
embodiment of the present invention includes, in addition to the 
structure of the above-described fifth embodiment, a decoder 
monitor 51 for monitoring the VLD unit 22, a reception side 
transmission channel monitor 53 for monitoring the reception 
side transmission channel, and a sending out side transmission 
channel monitor 63 for monitoring the sending transmission 
channel, these monitors 51, 53 and 63 being owned by the 
transcoder controller 3. The quantization step controller 73 
determines the quantization step information using the 
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information output from the input buffer monitor 52, output 
buffer monitor 62, reception side transmission channel monitor 
53, decoder monitor 51 and the sending out side transmission 
channel monitor 63. That is, the present eighth embodiment of 
5 the present invention includes a code rate conversion device 4 
and a transcoder controller 3. The code rate conversion device 
4 is made up of an input buffer 21, a VLD unit 22, an 
inverse-quantizer (IQ) 23, an adder 81, a quantizer 82, a VLC 
unit 83, an inverse-quantizer (IQ) 84, an adder 85, an 1DCT unit 

10 86, a frame memory 87, a difference calculating unit 88 and a 
DCT unit 89. The transcoder controller 3 is made up of an input 
buffer monitor 52, a reception side transmission channel monitor 
53, an output buff er mon i tor 62, a send i ng ou t s i de t ransm i ss i on 
channel monitor 63, and a quantization step controller 73. 

1-5 [0233] 

The operation of the code rate conversion device 4 and the 
operation of the transcoder controller 3 are similar to those 
of the code rate conversion device 5 in the previous sixth 
embodiment and the transcoder controller 3 in the previous 
20 fourth embodiment, respectively, and hence are not explained 
spec i f i ca I I y. 
[0234] 

The meritorious effects of the present invention 
are summarized as follows. 
25 As described above, the present invention gives the 
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following meritorious effects: 
[0235] 

The first effect of the present invention is that, since 
the time delay can be diminished, it is possible to realize 
5 encoding system conversion and code rate conversion suited to 
real-time communication. 
[0236] 

The second effect is that, since the quantization may be 
achieved by feedback of the pre-convers i on and post-conversion 
10 code volumes, the transmission channel band can be uti I ized most 
effectively, and the time delay produced in conversion can be 
diminished. 
[0237] 

The third effect is that control is managed not only from 
15 the encoding parameters obtained after VLD, but also from the 
input buffer, output buffer and code volume etc., and hence a 
more flexible conversion may be achieved. 

It should be noted that other objects, features and aspects 
of the present invention will become apparent in the entire 
20 disclosure and that modifications may be done without departing 
the gist and scope of the present invention as disclosed herein 
and claimed as appended herewith. 

Also it should be noted that any combination of the 
disclosed and/or claimed elements, matters and/or items may fal I 
25 under the modifications aforementioned. 



